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THE  GEORGE  WASHINGTON  UNIVERSITY 
School  of  Engineering  and  Applied  Science 
Institute  for  Management  Science  and  Engineering 

C'ogram  in  Logistics 

ANALYZING  MCCRES  DATA 
by 

Zeev  Rarzily 

I .  Introduction 

The  Marine  Corps  Combat  Readiness  Evaluation  System  (MCCRES) 
evaluates  the  performance  of  Marine  units  in  simulated  combat.  Specific 
tests  nave  been  designed  to  evaluate  infantry  jnits,  rotary  wing  and 
observation  squadrons,  combat  support  elements,  and  combat  service 
support  units.  The  present  report  deals  with  evaluating  the  performance 
of  infantry  batta Lions  as  described  in  Volume  il  of  MCCRES. 

A  major  difficulty  in  measuring  the  readiness  of  a  military  unit 
results  from  the  fact  that  the  unit  is  not  evaluated  under  real  combat 
conditions.  It  is  evaluated  instead  while  executing  several  exercises 
representing  typical  operations  the  unit  is  supposed  to  be  able  to 
execute.  To  avoid  this  difficulty  it  is  common  to  replace  the  question 
"Can  the  unit  do  me  job?"  by  "How  'close*  is  the  execution  to  the 
doctrine."  It  is  assumed  that  units  which  follow  the  doctrine  closely 
are  likely  to  be  able  to  do  the  job. 

Methods  for  assessing  the  readiness  of  military  units  arc  discussed 
in  our  survey  (!)  .  In  that  report  we  conclude  that  the  most  promising 
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approach,  in  our  opinion,  is  the  data  analysis  approach.  The  present 
paper  applies  this  approach.  in  Section  II  ve  describe  how  the  data 
are  collected  and  in  Section.":  II  i  and  IV  we  propose  a  method  for 
analyzing  data  that  come  fr,,m  MOCRES  evaluations.  The  analysis  aims 
at  helping  Lo  determine  measures  to  improve  the  performance  of  battalions 
in  MCCKF.S  and  to  determine  efficient  evalunt  :or,  procedures. 

II.  Description  of  the  Test  for  Infantry  Units 

Volume  11  of  MCCRES  consist  of  five  sad  ions.  Each  section 
consists  of  Mission  Performance  Standards  (MPS).  The  MPS  in  turn  consist 
of  tasks  and  each  task  consists  of  requirement  .,  which  are  the  most 
elementary  part  of  MCCRES.  The  composition  of  Volume  II  of  MCCRES  is 
given  in  Figures  1,  2,  3,  and  4.  The  only  missing  section  in  the  figures 
is  the  fit tii.  Section  2X  -  Standard  Performance  Tests.  This  secLion 
is  not  discussed  in  the  present  report.  We  do  not  list  the  require¬ 
ments  in  Figures  1-4,  because  they  number  793.  But  the  requirements  are- 
classified  according  to  the  ten  categories  of  Section  III  and  in  the  four 
figures  we  uresent  the  breakdown  of  the  requirements  into  these  ten 
categories. 

The  requirements  pose  questions  that,  wh^n  applicable,  can  be 
answered  either  by  YES  or  by  NO.  A  unit  scores  a  "YES"  if  all  conditions 
of  tiie  requirement  are  satistied,  otherwise,  it  scores  a  NO.  As  an 
example  we  list  here  the  requirements  that  constitute  the  task  2B.1.1  - 
Debarkation  for  MI'S  29B.L  -  Surface  assault. 

21!.  1.  1.1  -  Unit  prepares  for  debarkation: 

muster  personnel,  inspects  arms  and 
equipment,  and  issues  ammunition 

2B. 1.1.2  -  Final  debarkation  schedules  established  (KT) 

211.  I  .  I  .3  -  Debarkation  teams  report  to  debark  stations 
when  called  away  (KI) 

211.1.1.4  -  Vehicle  drivers  man  vehicles  when  called  away  (KI) 

211.1.1.3  -  Individual  marines  board  assault  amphibians  and 
landing  craft  in  an  expeditious  manner  (KI) 
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2.A.2.1  . HA  NEWER  CONTROL  1  0  0  0  0  0  1  5  0  0 

2.A.2.2 . RESPONSE  TO  DIRECTION  FROM  HIGHER  HEADOUMTERS  1  0  1  0  0  0  1  1  0  0 

2.A.2.3  . CONTROL  OF  ORGANIC  FIREPONER  0  0  1  0  2  1  1  Z  0  0 

2.A.2.4 . CONTROL  OF  ATTACHED  AND  SUPPORTING  FIREPONER  ASSETS  0  0  3  0  2  2  1  0  0  0 

NFS  2.A.2  2.A.7.5  . CONTROL  OF  SUPPORTING  NAVAL  GUNFIRE*  0  0  4  0  2  2  1  0  0  0 

Z.A.Z.B  . CONTROL  OF  AIR  DELIVERED  FIREPONER*  0  0  3  0  2  1  2  0  0  0 

CONNAND  2.A.Z.7  . LAMING  ZONE  CONTSML  AND  OPERATION  0  0  1  0  0  1  3  0  2  0 

AND  Z.A.Z.B  . COORDINATION  OF  INTELLIGENCE  EFFORT  Z  0  1  0  0  2  3  0  0  2 

CONTROL  2.A.2.9  . CONHUN I  CATIONS  COORDINATION  1  0  S  1  0  0  0  1  0  0 

2.A.2.10 . COORDINATION  OF  LOGISTIC  EFFORT  1  0  0  0  0  1  0  0  5  1 

2.A.2.U . COORDINATION  OF  CASUALTY  TREATMENT  AND  EVACUATION  1  0  0  0  0  0  2  0  3  0 

Z.A.2.12 . REPORTS  CONTROL  Z  0  0  0  0  0  3  0  0  0 


2. A. 3.1  . FSCC  OPERATION  0  0  1  0  8  1  1  0  0  0 

Z.A.3.2  . FSCC  MISSION  PROCESSING  0  0  1  0  6  0  0  0  0  0 

NFS  2.A.3  2.A.3.3 . . . MISSION  CLEARANCE  0000600000 

2.A.3.4  . OFFENSIVE  FIRE  SUPPORT  0  0  0  0  7  0  0  0  0  0 

FIRE  SUPPORT  Z.A.3.5  . DEFENSIVE  FIRE  SUPPORT  0000900000 

COORDINATION  Z.A.3.6  . COUNTERFIRE  PROGRAMS*  0  0  0  0  5  4  0  0  0  0 

2.A.3.7  . TARGET  INFORMATION  PROCESSING  BY  FSCC  0  0  0  0  7  0  0  0  0  0 


FlflURE  1 


NOTEI  *  DENOTES  AN  OPTIONAL  TASK 


SECTION  2.A.*  MISSION  PERFORMANCE  STANDARDS  APPLICABLE  TO  ALL  EVALUATIONS  IN  HCCRES 
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RE8UIREHENTS 
COUNTS  B  r 
CATEGORIES 

1  2  3  ♦  5  6  7  8  9  10 


R  P  C  P  D  P  C  E  P  S 

EROEELOXRU 
PEHRLANEOP 
0  P  H  F  I  N  F  C  V  E 

RAUOVNOUIR 


2.B.1.1  .  DEBARKATION  1000012202 

MPB  2.B.1  2.B.1.2  . ASSAULT  ACROSS  THE  BEACH  2  0  0  I  I  3  0  3  0  0 

2.B.1.3  . SEIZURE  OF  OBJECTIVES  2  0  0  0  1  1  0  3  0  0 

SURFACE  ASSAULT  2.B.1.4  . BUILDUP  OF  CONAT  POWER  ASHORE  2  0  0  0  0  0  1  1  3  0 

2.B.2.1  . PLANNING  1  2  0  0  0  6  0  0  0  0 

2.N.2.Z  . PREPARATION  0  3  0  0  0  1  0  0  2  2 

HPB  2.B.2  2.B.2.3 . ERPLANEHENT  0001001200 

2.B.2.4 . ABBRULT  IITO  LANDING  ZONE  1  0  0  1  0  0  1  2  0  0 

MELJC0PTERBOBNE  2.B.2.3  . SECURING  THE  LANDING  ZONE  1  0  0  0  2  1  1  3  0  0 

AB8AULT  2.B.2.6 . SEIZURE  OF  ASSIGNS  OBJECTIVE  2  0  0  0  0  0  0  3  0  0 

2.S.2.7 . LIMUP  2  1  1  0  0  1  0  2  0  0 


BPS  2.B.3  2.B.3.1  . PREPARATION  2  4  1  0  0  Z  0  0  0  0 

2.B.3.2  . ROUTE  COLUNN  1010000300 

NOVENNT  Z.B.3.3  . TACTICAL  COLUNN  3  1  1  0  0  0  0  5  0  0 

TO  2.B.3.4  . APPROACH  MARCH*  2  0  0  0  0  0  1  6  0  0 

CONTACT*  2.0. 3.3 . HFETJMQ  ENGAGEMENT.  1  1  0  0  1  1  0  2  0  0 


NOTES:  •  RENTES  AN  OPTIONAL  HP8 


*  DENTES  AN  OPTIONAL  TASK 


FI8URE  2.1  SECTION  2.8:  MISSION  PERFORMANCE  STANDARDS  APPLICABLE  TO  AMPHIBIOUS  ASSAULT 
AN  NORMAL  COMBAT  OPERATION  ASHORE  (FART  1  OF  2) 
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REBUIREMENTS 
COUNTS  BY 
CATEGORIES 

1  2  3  4  5  6  7  8  9  10 


RPCPDPCEPS 

EROEELOXRU 

PEHRLAMEOP 

OPHFIMFCVE 

RAUOVNOUIR 


2.B.4.1  . PLANNING  1  2  0  0  0  4  1  0  0  0 

2.1. 4. 2 . . . . . PREPARATION  0  2  1  0  0  0  1  1  2  1 

2.B.4.3 . . . PRELIMINARY  OPERATIONS  0  0  0  0  0  3  1  2  0  0 

NPS2.B.4  2/»  *.4  MANEUVER  FORWARD  OF  LOO  AND  SHORT  OF  FINAL  COORDINATION  LINE  3  0  0  0  1  1  0  4  0  0 
2.4. 4.5  ..ASSAULT  FROM  FINAL  COORDINATION  LINE  THROUGH  THE  OBJECTIVE  1000000500 

ATTACK  2.8. 4.6 . CONSOLIDATION  3  2  0  0  0  2  2  1  0  0 

2.B.4.7 . . . EMPLOYMENT  OF  THE  RESERVE  1  0  0  0  0  1  3  1  0  0 

2.B.4.8 . . . RESPONSE  TO  COUNTERATTACK*  2  0  0  0  1  1  2  2  0  0 

2.B.4.8 . . . CONHANO  POST  DISPLACEMENT*  1  0  0  0  0  2  1  1  0  0 


2.B.5.1  . PLANNING  1  3  0  0  0  4  1  0  0  0 

2  B.S.2  . PREPARATION  0  3  1  0  0  1  1  0  0  0 

NPS  2.B.5  2.B.3.3  . .....MANEUVER  1C  LINE  OF  DEPARTURE  0  0  0  0  0  0  3  1  0  0 

2.B.S.4  HAIEUVER  BETWEEN  THE  LOO  AND  TIC  PROBABLE  LINE  OF  DEPLOYMENT  10  110  114  0  0 

NIGHT  ATTACK  2.B.3.5 . ASSAULT  FROM  PLD  THROUGH  OBJECTIVE  1  0  1  1  0  0  0  3  0  V 

2.B.5.B . CONSOLIDATION  AND  MOVEMENT  OF  THE  RESERVE*  2  1  0  0  0  4  1  0  1  0 

2.B.5.7  . NIGHT  COMMAND  POST  DISPLACEMENT*  1  0  0  1  0  3  110  0 


2.B.B.1  . PLANNING  1  2  1  0  0  7  0  0  0  0 

2.1.6. 2  . ORGANIZATION  OF  THE  GROUND  0  2  1  1  0  4  1  0  0  0 

NPS  2.B.6  2.B.B.3  . ACTIONS  FORHARD  OF  THE  FEBA*  2  0  0  0  2  1  5  0  0  0 

2.R.8.4  . ACTIONS  ON  THE  FEBA*  1  0  0  2  0  1  0  2  0  0 

DEFENSE  2.B.6.3  . ACTIONS  PITKIN  THE  POSITION*  1  1  0  0  0  0  1  3  0  0 

2.A.S.S . COUNTERATTACK*  3  0  0  0  0  2  1  2  2  0 


2.B.7.1  . PLANNING  1  1  0  0  0  4  0  0  0  0 

NPS  2.D.7  2.B.7.2 . PREPARATION  1  1  0  0  0  3  0  0  3  0 

2.B.7.3  . DELAYING  ACTION  3  0  0  0  0  1  0  6  0  0 

RETROGRADE  2.B.7.4  . WITHDRAWAL  UNDER  ENEMY  PRESSURE  2  0  0  0  1  2  0  3  0  0 

OPERATIONS*  2.D.7.5 . HITWRAHAL  WITHOUT  ENEMY  PRESSURE  2  0  0  0  0  3  0  4  0  0 

2.B.7.6 . RETIREMENT  2000030100 


NOTES.'  •  DENOTES  AN  OPTIONAL  NPS 


*  DENOTES  AN  OPTIONAL  TASK 


FIGURE  2.2  SECTION  2.B.*  MISSION  PERFORMANCE  STANDARDS  APPLICABLE  TO  AMPHIBIOUS  ASSAULT 
AND  NORMAL  COWAT  OPERATIONS  ASHORE  'PART  2  OF  2) 
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REOUIRENENTS 
COUNTS  IT 
CATEGORIES 

1  23456789  10 


R  P  C  P  D  P  C  E  P  S 
EROEELOXRU 
PEHRLANEOP 
OPHFINFCVE 
RAUOVNOUIR 


2.C.1.1  . PLANNING  1200040000 

NPS  2.C.1  2.C.1.2 . PREPARATION  0  1  1  0  0  0  0  2  0  2 

2.C.1.3 . TANKS  AND  INFANTRY  ON  SANE  AXIS*  2000020500 

TANK-INFANTRY  2.C.1.4  . TANKS  AND  INFANTRY  CONVERGING  AXES*  2  0  0  0  1  1  0  7  0  0 

OPERATIONS*  2.C.1.5  . TANKS  SUPPORT  BY  FIRE  ONLY*  2  0  0  0  0  1  0  3  0  0 


NPS  2.C.2  2.C.2.1  . . . PLANNING  1  2  1  0  0  2  0  0  0  0 

hECHAMZED  2.C.2.2  . .....PREPARATION  04000120  00 

OPERATIONS  2.C.2.3 . COUNTED  HANEUVER  2000120400 


2.C.3.1  . . . PLANNING  1  2  0  0  1  4  0  0  1  0 

NPS  2.C.3  2.C.3.2  . PREPARATION  0  3  1  0  0  1  0  0  1  0 

2.C.3.3 . ISOLATION  OF  THE  BUILT  UP  AREA  2  0  0  0  1  0  0  2  0  0 

NILITARY  OPERATIONS  2.C.3.4 . SEIZURE  OF  AN  INITIAL  FOOTHOLD  IN  BUILT  UP  AREA  1  0  0  0  1  0  0  2  0  0 

IN  2.C.3.S  ...ARMANCE  THROUGH  BUILT  UP  AREA  AND  EJECTION  OF  ENEHY  FORCE  1000000700 

BUILT  UP  AREAS*  2.C.3.6 . A8SUNPTI0N  OF  THE  DEFENSE  IH  A  BUILT  UP  AREA  2  0  I  0  0  6  1  I  0  0 


NP8  2.C.4  2.C.4.1  . PLANNING  AND  PREPARATION  1  3  0  0  0  4  0  0  0  0 

EVACUATION  2.C.4.2 . INITIAL  SCREENING  OF  EVACUEES  3  0  0  0  0  0  2  0  0  0 

OPERATIONS*  2.C.4.3  .SECURITY  RESPONSIBILITIES  FOR  THE  EVACUATION  CONTROL  CENTER  0000012000 


2.C.5.1  . PLANNING  XXXXXXXXXX 

2.C.5.2 . PREPARATION  XXXXXXXXXX 

2.C.5.3  . CONCEPT  OF  OPERATIONS  XXXXXXXXXX 

2.C.3.4  . TASK  ORGANIZATION  XXXXXXXXXX 

2.C.5.5 . &HEHE  OF  MIEUUER  XXXXXXXXXX 

NPS  2.C.5  2.C.5.B . SHIP  TO  SHORE  HDVEHENT  XXXXXXXXXX 

2.C.5.7 . . . APPROACH  TH  RAID  OBJECTIVE  XXXXXXXXXX 

AHPHIBIOUB  RAID*  2.C.5.B . ASSAULT  ON  THE  RAID  OBJECTIVE  XXXXXXXXXX 

2.C.5.8 . RETIRENENT  TO  THE  EXTRACTION  POINT  XXXXXXXXXX 

2.C.5.10 . REE70ARKATION  XXXXXXXXXX 

2.C.5.11 . DEBRIEF  XXXXXXXXXX 

2.C.5.12 . SPECIAL  CONSIDERATIONS  FOR  NIGHT  OPERATION  XXXXXXXXXX 


NOTES:  «  DENOTES  AN  OPTIONAL  NPS 


*  DENOTES  AN  OPTIONAL  TA 


FIGURE  3  SECTION  2.C.*  MISSION  PERFORMANCE  STANDARDS  APPLICABLE  TO  SPECIALIZED  CONBAT  OPERATIONS* 
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RE8UIRENENTS 
COUNTS  BY 
CATEGORIES 

1  23456789  10 


R  P  C  P  D  P  C  E  P  S 
EROEELOXRU 
P  E  N  R  L  A  N  E  0  P 
OPHFINFCVE 
RAUOVNOUIR 


2.0.1. 1  . . . INITIAL  FLANNINB  PROCEDURES  IZ00060000 

2.0. 1.2 . SCHEME  OF  HAMMER  0  0  0  0  0  0  0  0  0  0 

NPS  2.0.1  2.0. 1.3 .  . LAMING  PLAN  0  0  0  0  0  7  0  0  0  0 

2.0. 1.4  . FIRE  SUPPORT  PLAMING  0000800000 

ANPHIIIOUB  2.0. 1.5 . INTELLIGENCE  PLAMING  1  100050000 

AOORNLT  2.0.1. 0  . CONNUNICATIOM  PLAMING  0  1  6  0  0  1  0  0  0  0 

PLAMIM  2. 0.1. 7  . . . AONIN.  L06ISTIC8  PLAMING  0  0  0  0  0  0  0  0  4  0 

2.0.1. 0 . EMMIATION  PLAMIM  0  0  0  0  0  6  0  0  0  0 

2.3.1.9  . REKAR8AL  PLAN#  0  0  0  0  0  6  0  0  0  0 


MB  2.1.2  2.0.2. 1  . PREPARATION  1  5  0  0  0  0  1  0  2  0 

MOARRATION  2.C.2.2 . CONTROL  MEASURES  AT  POE  0  1  1  0  0  2  1  0  0  0 

FM  2.0.2. 3 .  ..NOTOOT  TO  POE  0100001050 

AMHIIIOUO  ASSAULT*  2. 0.2. 4 .  . LOADING  1  0  0  0  0  0  0  3  2  0 


NPO  2.0.3  2.0.3.1  . SEA  TRAMIT  0700010000 

IAEA  TRAN  ♦  GOKARSAL*  2.0.3.2 . REHEARSAL  0  5  1  0  0  3  0  0  0  0 


NOTES.*  •  SEMITES  AN  OPTIONAL  NPS 


•  DENOTES  AN  OPTIONAL  TASK 


FIGURE  4  SECTION  2.0.'  MISSION  PERFORMANCE  STAMARK  APPLICABLE  TO  OPERATIONAL  ACTIONS  DEPENDENT  UPON  OUTSIDE  ASSETS* 
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2E.J.1.6  -  lndentifying  boat  paddles  displayed 

2B.1.1.7  -  Radio  sile^'-c  maintained  until  l.OD  crossed 
unless  CATF  specifically  authorizes  easing 
of  EMCGN 

2B. 1.1.8  -  Unit  reports  crossing  ol  LGD  to  high  HQ. 

In  many  cases  there  are  tie;  Indicators  (Kl)  for  the  evaluators  which 
list  specific  items  and  precise  details  necessary  for  a  score  of  YES; 
these  introduce  considerable  objectivity  and  uniformity. 

Throughout  this  report  we  refer  to  the  sections,  missions,  tasks, 
and  requirements  as  elements  belonging  to  level  1,  levej  2,  level  3  and 
level  4,  respectively.  As  explained  earlier,  each  element  in  level  i 
(i  =  1,  2,  3)  consists  of  several  elements  in  the  (i+l)st  level.  The 
elements  in  the  (i+l)st  level  will  be  designated  as  the  partition  of 
the  element.  The  relative  importance  of  the  elements  of  a  partition  is 
reflected  by  the  weights  assigned  to  them.  For  example,  the  four  tasks 
of  MPS  2B.1  -  Surface  assault,  see  Figure  2.1,  have  the  weights  40, 

100,  100,  and  70,  respectively. 

The  evaluation  process  starts  with  the  determination  of  the 
applicable  elements.  This  determination  is  necessary  since  evaluating 
all  MCCRES  elements  in  a  single  exercise  would  require  such  a  long  period 
of  time  and  so  many  resources  as  to  be  impractical.  If  the  applicable 
elements  are  carefully  selected,  then  an  accurate  picture  of  the  state 
of  readiness  of  a  unit  can  be  obtained  even  though  some  elements  are 
omitted.  After  deciding  on  the  applicable  elements  then,  the  weights 
of  those  elements  are  normalized.  For  example,  if  2B.1.L,  2B.1.2, 
and  2B.1.3  are  applicable  and  2B.1.4  is  not,  then  using  the  nonnormal ized 
weights  giver,  earlier  yield  the  following  respective  normalized  weights 

100 
240  ’ 
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Finally,  wo  obtain  an  absolute  weight  for  carl;  applicable  requirement 
of  an  evaluation  by  multiplying  irs  normalized  weight  by  Lhe  normalized 
weights  of  its  task,  MPS,  and  section.  By  following  this  procedure  the 
sum  of  the  requirement's  absolute  weights  equals  unity.  The  evaluation 
score  is  defined  to  equal  the  sum  of  the  absolute  weights  in  which  the 
unit  obtained  a  "YES." 

As  indicated  earlier,  the  first  phase  of  an  evaluation  is  the 
determination  of  the  applicable  parts.  Some  parts  must  be  applied 
whenever  an  evaluation  is  conducted  while  others  are  optional  and  are 
to  be  selected  by  the  units  command.  In  Figures  1-4  we  indicate 
the  optional  and  compulsory  parts  of  MCCRES.  (The  next  section  includes 
a  discussion  of  the  determination  of  an  evaluation's  applicable  parts.) 
Deciding  not  to  apply  a  part  means  that  all  related  parts  in  lower  levels 
become  Not  Applicable  (N/A) .  Sections  C  and  D,  for  example,  are  optional. 
Thus,  if  Section  C  is  chosen  to  be  N/A  in  an  evaluation  then  all  of  the 
Mission  Performance  Standards,  Tasks,  and  Requirements  related  to  C 
become  N/A.  If,  on  the  other  hand,  it  is  decided  to  apply  Section  C, 
then  C2  is  compulsory  but  Ci ,  C3,  and  C4  are  optional.  Examining,  Figures 
1-4  we  find  that  the  compulsory  parts  of  Volume  11  constitute  about 
50  percent  of  the  total  number  of  requirements. 

The  second  phase  of  an  evaluation  is  the  evaluators'  briefing. 

The  evaluators  are  usually  officers  whose  battalions  are  to  be  evaluated 
in  the  near  future  and  this  experience  with  MCCRES  helps  them  to  prepare 
for  their  evaluation.  In  the  briefing  the  evaLuators  are  assigned  to  the 
unit's  components  and  are  informed  about  the  applicable  parts  of  MCCRES. 
They  are  also  instructed  how  to  observe  the  details  of  the  battalion's 
performance  and  how  to  decide  on  the  YESs  and  YOs. 

The  next  phase  is  the  simulated  combat.  Uhiic  the  unit  is 
executing,  the  evaluators  take  notes  and  decide  or.  the  scores.  The 
evaluators'  task  is  very  tedious  since  they  have  to  pay  attention  to 
numerous  aspects  of  the  execution  and  have  to  make  many  quick  judgments. 
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Wlii'ii  I  lu'  simulated  combat  is  over,  t  Ik-  evaluators  gather  and 
under  the  supervision  of  the  senior  evaluator  they  decide  on  a  common 
score  for  each  requirement.  This  score  reflects  the  overall  performance 
of  the  battalion.  The  common  scores  then  yield  the  evaluation's  score. 

111.  A  Categorization  of  MCCRES  Requirements 

The  YESs  and  the  NOs  of  an  evaluation  contain  considerable 
information  concerning  the  weaknesses  and  the  strengths  of  the  battalion. 
The  difficulty  in  analyzing  the  data  is  due  to  the  high  dimensionality  - 
several  hundred  requirements.  To  overcome  t.iis  difficulty  we  initiated 
classifying  ail  the  requirements  according  to  a  set  of  mutually  exclusive 
and  exhaustive  categories.  A  preliminary  set  of  nine  categories  was 
suggested  by  us  and  a  tenth  category  was  added  through  an  audit  by 
instructors  at  the  Infantry  Officers  Course,  basic  School.  The  ten 
categories,  where  the  numbering  has  no  special  significance,  arc  as 
lollows. 

1.  REPORTING  to  higher  levels  of  command 

2.  PREPARING  for  operations 

1.  COMMUNICATING  (including  Communications  SOPs) 

4.  PERFORMING  as  Marines  (discipline,  dispersion,  camouflage 

concealment,  using  weapons,  and  so  on) 

5.  DF.L1VERING  supporting  fire 
E.  PLANNING  of  op -“rations 

1.  CONFORMING  to  doctrine 

8.  EXECUTING  operations 

9.  PROVIDING  combat  service  support  (inrLjding  medical  support) 

10.  SUPERVISING  required  actions  of  individual  Marines. 

Each  category  corresponds  to  a  vital  aspect  of  the  unit's  performance 
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during  the  evaluation  and  each  requirement  is  to  be  assigned  to  the  .single 
category  judged  to  most  closely  fit  the  most  essential  ic.iturc  nl  the 
requirement.  The  above  categories  are  chosen  so  that  they  not  only  make  it 
possible  to  classify  the  rc qui rements  buL  so  that  they  correspond  to  spec  i  t 
areas  for  training  and  remedial  actions  whir.'  can  be  used  to  improve  combat 
read iness . 

We  now  explain  in  some  detail  the  meaning  of  the  ten  categories.  In 
general,  commands  of  units  are  mainly  evaluated  by  the  following  categories 
6(Planning),  2 (Preparing) ,  8 (Execut ing) ,  i (Report ing) ,  7 (Conf ormi ng) , 

and  lO(Supervising) .  The  performance  of  individual  Marines  is  evaluated 
by  4 (Per form  ing)  and  the  performance  of  some  special  groups  is  evaluated 
by:  3 (Communicating) ,  5(Delivering) ,  and  9(Providing) . 

Performance  of  the  Command 


Let  us  consider  the  six  categories  that  mainly  evaluate  command. 
The  first  is  6(Planning  of  operations).  This  category  deals  with  the 
question:  How  well  are  the  operations  planned'  Examples  are 


2A.1.5.4 


2R.4.8.5 

2B.6.1.3 


2B.6.2.2 


Patrols  not  dispatched  on  repetitive  or 
stereotyped  routes 

Reserve  is  positioned  to  assist  forward  elements 
in  containing  any  penetration 

Staff  coordination  IAW  FMFL  3-1;  emphasis: 
organization  of  the  ground,  integration  of 
fire  planning,  security  operations,  and 
intelligence  collection 

Machine  guns  are  positioned  to  deliver 
flanking  interlocking  grazing  fire  from 
mutually  supporting  positions. 


The  next  is  2(Preparing  for  operations).  Preparations  start  after  some 
phases  of  planning  have  been  completed.  Preparations  include  Issuing 
orders,  rehearsals,  and  accomplishing  some  other  preliminaries.  Examples 
are 


24.1.5.5  -  Marines  assigned  to  security  actions 
thoroughly  briefed  and  inspected 
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2A.1  .6.2 


Uni  l  t"  patrol  i.s  alerted  a  minimun  ot  four 
hours  prior  to  patrols 


213.2,2.1  -  Individual  Marines  and  their  equipment 
inspected 

2C. 3.2.4  -  Small  unit  leaders  in  assaelt  elements 

conduct  rehearsal  of  specialized  techniques 
required  (1,1)  . 


Next  is  8(Executing  operations).  These  requirements  measure  the  leader¬ 
ship  of  the  unit's  command  and  the.  teamwork.  Examples  are 


2A.2.1.2  -  Unit  exercises  control  over  maneuver  of 
subordinate  elements  (KI) 


211.1.1.3  - 


2B.4.3.6  - 


211. 2. 3. 3  - 


2C. 3.6. 10- 


Debarkation  teams  report  to  debark  stations 
when  called  away  (KI) 

Assault  elements  move  into  attack  positions 

Speed  and  momentum  of  movement  maintained 

Attacking  enemy  forces  halted  and  ejected 
from  built  up  areas. 


Next  is  l(Keporting  to  higher  levels  of  command).  Included  here  are 
acknowledgments  of  receiving  orders,  reports  on  progress  of  operations, 
and  reports  on  information  obtained  about  the  enemy.  Examples  are 


2B.4.4.7 

2B.4.8.1 


2B.4.8.4 


2B. 1.5.6 


Bypassed  enemy  units  repon  ed  by  assault 
elements 

Security  elements  report  eremy  counter¬ 
attack  preparations 

Unit  reports  counterattack  to  higher  !1Q 
Seizure  of  objective  reported  to  higher  HQ 


Next  is  7(Conforming  to  doctrine).  Examines  the  technical  knowledge 
of  the  command.  These  requirements  are  normaily  easy  to  satisfy  provided 
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the  command  does  not  forgot  (or  overlook)  them.  Examples  are 

24.  1.0.2  -  Unit  h..s  an  alarm  system  for  gas  or  other 
them  ice  1  attack 

2A.2.1.1  -  Unit  lies  and  uses  an  operation  SOI’ 

213.5.1.1  -  Security  element  provides  guides  to  lead 
assault  elements  to  I.0D 

2C.4.2.2  -  Marines  who  make  the  initial  contact  immediately 
begin  screening  evacuees  into  categories  (KI). 

Last  is  10(Supervising  required  actions  of  individu.il  Marines).  Require¬ 
ments  here  are  satisfied  through  observation  and  appropriate  direction. 
These  are  usually  provided  at  company  commander  or  lower  levels.  Examples 
are 

2A.1.1.2  -  Weapons  maintenance  discin’ ine 

2A.1.3.2  -  Haited  elements  do  not  remain  in  exposed 
locales,  moving  immediately  into  nearest 
cover . 

Performance  of  Individual  Mar ines 

Here  the  requirements  concern  how  well  the  Marines,  as  individuals, 
are  prepared  to  execute  their  jobs.  All  are  classified  under  4(Performing 
as  Marines).  Principal  concerns  are  discipline,  dispersion,  camouflage, 
concealment,  using  weapons,  and  so  on.  Examples  are 


2A. 1.10.4  -  When  attacked.  Marines,  including  officers 
and  NCOs,  react  by  taking  cover 

2A.2.10.5  -  Unit  keeps  stockpiles  of  material  and 
ammunition  dispersed 

2B.2.4.1  -  On  landing.  Marines  deplane  quickly  and 

safely  and  disperse  as  helicopters  lift 
out  of  zone 

2B.4.5.2  -  Assault  elements  deliver  heavy  volume  of 

fire  as  they  close  on  objective. 


The  Performance  of  Some  Special  (Iroiips 

Three  categories  til!  under  this  heeding.  The  first  is 
HCiwnmunirnt  ing)  .  These  .equi  rement  s  den  l  with  the  performance  of  the 
teams  in  charge  of  the  operation  of  the  radio  and  wire  communications. 
Tile  question  is:  ean  the  units  properiy  transmit  the  required  informa¬ 
tion?  Also  included  are  communications  SOPs.  Examples  are 


2A.1.8.1  -  All  radio  nets  specified  as  covered  circuits 
in  the  communications  plan  operate  in  the 
covered  modes 

2A.2.2.3  -  Unit  enters  tactical  and  co.nmand  nets  of 
higher  HQ 

2A.2.7.4  -  L2  communications  provide  positive  control 
of  inbound  and  outbound  helicopters  (Kl) 

2A.  3.2.1  -  FSCC  communications  are  functioning  (Kl) 

The  next  Is  5(Delivering  supporting  fire).  This  category  evaluates  the 
entire  performance  of  the  supporting  fire  un.ts.  Examples  are 


2A.3.2.3  -  Routine  calls  for  fire  are  monitored,  recorded, 
and  plotted 

2A.3.6.1  -  Counterfire  priorities  are  ’ncluded  in  tire 
support  planning 

2B.1.3.3  -  As  soon  as  direct  support  artillery  is 

emplaced,  FO's  with  lead  elements  direct 
fire  against  appropriate  targets 

2B-4.8.3  -  All  available  fire  support  employed  against 
counterattack. 


hast  is  S)(Providing  combat  service  support).  The  performance  of  t  hi' 
logistics  and  medical  groups  is  evaluated  here.  Examples  are 

2b. 1.4. 4  -  Emergency  resupply  capability  retained  as 
material  is  staged  ashore  (Kl) 


211.4.2.6 


Vehicles  checked  for  fuel  state  and  refueled. 


211.6.6.9  -  Immediate  action  taken  in  reconstitute  supply 
and  ammunition  levels  prescribed  for  1 1  it? 
position  in  the  defense  older 

2C.J.2.3  -  Specialized  equipment  issued  (K.I). 

The  following  table  gives  some  indication  of  the  relative 
importance  of  the  ten  categories.  (See  Figures  1-4  lor  more  details.) 

Table  1:  The  relative  importance  of  the  ten  categories. 


Categories 

Number 

of 

Requirements 

l. 

REPORTING 

105 

2. 

PREPARING 

81 

1. 

COMMUNICATING 

48 

4. 

performing 

29 

3. 

DELIVERING 

78 

6. 

PLANNING 

167 

7. 

CONFORMING 

81 

8. 

EXECUTING 

144 

9. 

PROVIDING 

41 

10. 

SUPERVISING 

19 

TOTAL 

793  j 

_ 

Percentage 
of  number  of 
requirements 
under  this  Category 


Category 


From  general  considerations  it  would  be  desirable  to  avoid  using  categoric* 
in  which  very  few  requirements  appear  (because  this  would  tend  to  indicate 
that  such  categories  were  relatively  unimportant)  or  in  which  too  many 
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appear  (because  this  would  indicate  that  there  might  he  duplication  of 
concepts  or  that  potential  information  was  being  lost  through  excessive 
aggregat ion) . 

A  computer  program  has  been  written  to  do  the  following. 

(1)  Calculate  evaluations  scores 

(2)  Repeat  the  above  calculations  under  the  change 
that  all  requirements  are  given  equal  weights 

(3)  Compute  categories  scores.  (Total  weights  of  YESs 
divided  by  total  weights  of  applicable  requirements.) 

The  computer  program  was  run  with  data  of  13  evaluations.  The  Not  Appli¬ 
cable  (N/A)  parts  of  these  evaluations  are  given  in  Tabic  2  and  the 
results  ol  ihe  computer  runs  are  shown  in  Table  3.  The  mean  score  of 
category,  tile  right-hand-side  column  of  Table  3  is  simply  the  mean  of 
the  scores  of  the  category  in  the  13  evaluations.  The  unweighted  scores 
are  the  scores  obtained  when  it  is  assumed  that  all  applicable  require¬ 
ments  have  the  same  weights. 

Examining  the  results  of  Table  3  we  realize  that  Category 
4(Performing  as  Marines)  scores  70  on  the  average,  which  is  lower  than 
the  others.  It  is  also  interesting  to  note  that  Category  5  scores  93 
on  the  average,  which  is  better  than  the  others.  Each  of  the  units  has 
its  weaknesses  and  strengths.  Unit  Number  1,  for  example-,  was  weak  in 
Categories  4  (60.0%),  8  (69.8%),  9  (69.1%),  and  10  (67.67).  but  this  unit 
performed  very  well  in  Categories  3  (100%),  and  6  (93%).  Ihe  results 
shown  in  Table  3  Indicate  that  all  units  have  their  strengths  and 
weaknesses,  and  thus  calculating  these  scores  can  help  in  planning  ol 
remedial  training. 
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Mi'  2:  I  ist  ot  N/A  Sections,  MPSs,  and  Tasks  in  13  Evaluations. 


Number  of 
Applicable 
Requ Irements 

List  of  N/A  Parts 

610 

84.9,  B5,  B6.4,  B6.5,  B6.6,  B7.3,  B7.4,  87.6,  HI,  C 3 

o // 

B5.7,  B6.3,  B6.4,  B7.3,  B7.4,  B7.5.  B7.6,  Cl. 4,  Cl. 5, 
C3 

178 

Bl,  B2 ,  B3.2,  B4 . 8 ,  B3,  B7 ,  C,  D 

488 

A 1 . 7 ,  A3. 6,  B3. 2,  B4.S,  B5,  B6.4,  B6.6,  B7.3,  H7.4. 

Cl,  C3,  D 

342 

B2.3,  B3.4,  B3.5,  84. 8,  B5.6,  B5.7,  B6,  B7.J,  17.4,  ! 

B7.6,  Cl,  C3 ,  D1.9,  D2,  D3,  D4 

4  34 

B2.  B3,  B5,  B7,  Cl. 4,  C3,  C4,  D 

484 

A 1  . 9 ,  A1.10,  A2 . 5 ,  B3 ,  B4.9.  liS ,  S6.4,  116.3,  116.6, 

B7 ,  C,  D4 

. 

48b 

A 1  . 8 ,  A1.9,  A1.10,  A2.3,  BJ  ,  B6.3,  B6.4,  116. 4,  1,6.6, 
B7,  Cl,  C4 ,  D 

366 

Bl,  B3.5,  B5.7,  B6.6,  H7.6,  C3,  C4»,  0 

r>9  2 

A1.7,  B2.7,  B5,  B6.3,  B6.4,  B7.1,  B7.4,  117. 6,  Cl,  Cl, 
D2.2,  D2.3 

] 

246 

1 

A1.4,  A1.7,  Ai.8,  A1.10,  Al.ll,  Ai.12,  A 2.2,  A2.i, 
A2.4,  A2.3,  A2.6,  A2.7,  A2.10,  A  2 . 1 1  .  A2.13,  A  1 . 2  , 

A3. 3,  A3. 5,  A3 .  b,  A3. 7,  Bl  ,  B2,  Bl,  114.7,  B4.8,  114.9, 
B3.6,  B5.7,  B6,  B7,  Cl,  C2,  C4 ,  1) 

\  19 

A2.5,  Bl,  B  3 ,  B3,  B7,  Cl. 4.  Cl,  C  s.  1) 

■ 

28/ 

A1.6,  A2.4,  A2.3,  A2.6,  A 2.7,  Al,  11 1,  112,  111, 

B4.9,  B5 ,  B6 .  3 ,  117,  Cl.  4.  C3,  C4 ,  1) 

Cat.  2 


Cat.  4 

Cat .  5 

Cat .  6 
Cat .  7 

Cat.  8 

Cat.  9 

Cat  10 


. 

r 

j  98 

1 

89 

64 

81 

89 

76 

46 

87 

82 

97 

80 

93 

83 

87 

90 

94 

89 

99 

84 

100 

Evali 

5 

6 

70 

90 

83 

100 

93 

68 

86 

93 

96 

92 

95 

92 

88 

94 

93 

91 

79 

100 

90 

100 

Number 

8 

9 

10 

1 

1 

85 

34 

77 

1 

76 

86 

97 

88 

36 

96 

76 

77 

1 00 

90 

52 

84 

79 

54 

90 

73 

76 

87 

89 

26 

SI 

74 

69 

100 

100 

KvaJ  ua 


Score 


91  87  91  90 


Weighted 


94  87  93  93 


89  |  92 
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The  key  assumption  in  this  section  is  that  requirements  belonging 
to  the  same  category  pose  similar  demands  on  the  unit’s  components  and, 
thus,  have  the  same  probability  of  scoring  a  YES.  This  assumption 
is  related  to  but  not  impLied  by  the  definition  of  the  categorization. 

We  examine  the  feasibility  of  this  assumption  in  two  ways.  First  we 
compare  MI’S  category  scores  to  evaluations  categories  scores  in  several 
evaluations.  The  results  are  given  in  Table  4.  (The  numbers  in 
parentheses  in  the  table  are  the  numbers  of  the  MPS  requirements 
belonging  to  the  given  category.)  We  then  examine  the  effects  of 
reducing  the  number  of  applicable  requirements  on  the  evaluations  and 
categories  scores.  We  use  the  13  evaluations  of  Table  2  and  for  each 
evaluation  we  ran  three  cases  in  which  some  of  the  optional  applicable 
parts  were  removed  by  assigning  them  as  N/A.  A  description  of  the  39 
cases  and  the  results  of  the  computer  runs  are  given  in  the  appendix. 

The  results  are  summarized  in  Figures  5  and  6.  In  all  cases  examined, 
we  observed  that  the  categories  scores  came  close  to  the  original 
categories  scores.  This  observation  indicates  that  our  assumption 
is  reasonable. 

The  data  in  Table  4  and  in  Figures  5  and  b  strongly  suggest 
that  the  number  of  applicable  requirements  can  be  substantially 
lower  than  793  while  the  category  scores  still  remain  precise. 

This  result  is  important  because  the  evaluation  of  a  battalion  on 
all  requirements  would  require  substantial  resources.  Note  that  only 
about  50  percent  of  the  requirements  must  be  applied  whenever  an  evalua¬ 
tion  is  conducted,  while  the  others  should  be  chosen  according  to  the 
expected  deployment  of  the  unit  and  the  available  resources.  The  second 
result  is  related  to  the  determination  of  a  training  program  and  is 
discussed  in  the  remainder  of  this  section. 

Several  factors  such  as  the  available  budget,  the  length  of  the 
training  period,  and  possible  future  deployment  should  be  taken  into 
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account  when  a  training  program  of  a  Marine  Unit  is  determined.  For 
example,  it  may  be  desired  to  train  a  unit  under  severe  budget  constraints 
for  a  helicopterborne  assault.  Then  it  may  be  useful  initially  to  train 
the  unit  to  execute  lower  cost  but  related  MPSs  and  only  later  to  begin 
execution  of  the  mere  expensive  helicopterborr-e  assaults.  Another 
example  might  be  that  one  wants  to  train  a  unit  for  the  execution  of 
a  night  attack.  There  the  question  could  be:  how  can  some  daytime 
MPSs  be  selected  that  can  also  serve  to  train  the  unit  for  night 
attacks?  We  are  interested  therefore  in  a  method  for  measuring 
"distance"  between  MPSs.  Namely,  two  MPSs  are  considered  to  be 
"close"  if  they  require  similar  efforts  from  a  unit's  components  so 
that  training  for  either  one  will  also  improve  the  performance  of  the 
other. 


To  be  able  to  measure  distance  between  MPSs  we  define  the 
composition  of  an  MPS  as  the  distribution  of  the  number  of  its 
requirements  among  the  ten  categories.  (We  prefer  to  calculate  the 
distribution  of  the  number  or  requirements  rather  than  the  distribution 
of  their  weights  because  of  mathematical  convenience,  but  the  results 
do  not  change  much  if  the  second  alternative  is  taken.)  Table  5 
presents  the  composition  of  the  MPSs.  We  explain  the  entries  of  the 
table  by  explaining  those  of  the  first  row.  The  number  90  in  the 
final  column  indicates  that  MPS  2.A.1  contains  90  requirements:  twelve 
percent  of  them  belong  to  category  1  (11  requirements),  ten  percent 
belong  to  category  2  (9  requirements),  and  so  on.  We  see  that  MPS 
2.A.1  contains  the  smallest  (17).  Some  MPSs  contain  requirements 
belonging  to  many  categories,  2.D.3  for  example.  Now,  define  the 
distance  between  the  composition  of  two  MPSs  as  the  sum  of  absolute 
deviations  between  their  composition  entries.  For  example,  referring 
to  the  data  in  Table  5,  we  calculate  the  distance  between  the  composi¬ 
tion  of  2.A.1  and  2. A. 2  as  the  sum  of  absolute  values 

| 12-10 |+| 10-0 |+| 5-23 |+| 21-1 |+| 0-9 |+| 3-11 |+| 20-21 |+| 15-10 |+| 3-11 |+| 11-4 
=  2+10+18+2  0+9+8+1+5+8+7 
=80. 
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This  iorm  of  distance  is  often  used  and  it  has  useful  mathematical 
properties.  The  distance  between  two  MPSs  varies  from  0,  where  they  have 
the  same  composition,  to  200  (where  they  do  not  have  any  categories  in 
common).  The  choice  of  this  distance  function  is  logical  if  all  catego¬ 
ries  are  equally  important  and  if  any  two  deviations  of  x  percent  are 
us  meaningful  as  one  deviation  of  2x  percent.  Table  6  presents  t lie 
distance  between  each  pair  of  the  17  MPSs  of  Volume  II  of  MCCRES.  The 
numbers  in  the  parentheses  are  the  distances  between  the  MPSs.  We 
realize  that  some  MPSs  have  many  close  MPSs,  2.B.1,  2.B.2,  for  example, 
white  others  like  2. A. 3  and  2.D.3  do  not. 

V.  Summary 


In  the  present  report  we  have  described  MCCRES  and  some  analysis 
performed  on  MCCRES  data.  We  feel  that  MCCRES  has  the  following  merits. 

(a)  Most  requirements  are  requests  for  descriptive 
data  and  not  for  judgments.  Judgments  were 
previously  made  by  defining  the  requirements 
and  assigning  weights. 

(b)  The  details  of  the  doctrine  are  given  and 
interpreted  in  the  requirements,  thus 
avoiding  the  possibility  of  being  mis¬ 
interpreted  or  forgotten  by  the  evaluators. 

(c)  The  execution  of  most  requirements  consume 
short  time  periods  and  thus  the  evaluator's 
memories  are  not  overburdened. 

fd)  Assigning  a  score  of  a  YES  or  NO  is  easier 
than  assigning  scores  on  any  other  scale. 

(e)  The  set  of  requirements  exhausts  the  details 
of  the  executions. 
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The  merits  described  above  help  the  evaluators  to  assign  objective 
scores . 


The  analysis  of  the  evaluations  data  has  three  objectives.  The 
first  objective  is  to  determine  the  weaknesses  and  strengths  of  the 
evaluated  battalions.  We  reach  this  goal  by  calculating  catepories 
scores.  These  scores  can  help  determine  remedial  actions;  for  example, 
to  improve  a  poor  performance  in  category  6  (Planning)  it  may  be  efficient 
to  train  rhe  Marines  involved  in  planning  by  assigning  them  several 
operations  to  plan.  The  second  objective  is  the  examination  of  the 
sensitivity  of  the  scores  to  the  number  of  applicable  requirements. 

Here  we  observe  that  reducing  the  number  of  applicable  requirements 
to  about  60  percent  yields  scores  which  are  fairly  precise.  The  third 
objective  is  the  determination  of  close  MPSs.  Here  we  define  a  measure 
of  distance  between  MPSs.  We  believe  that  close  MPSs,  according  to 
the  proposed  measures, require  similar  efforts  from  units'  components 
and  thus  training  for  an  MPS  will  improve  the  performance  in  all  MPSs 
that  are  close.  As  we  obtain  more  MCCRES  evaluation  data  we  will 
be  able  statistically  to  test  our  findings  in  objectives  two  and  three. 
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Table  A. 2:  Evaluations  and  Categories  Scores  in  the  Cases 

Described  in  Table  7. 

(The  first  case  in  each  evaluation  set  contains  only  compulsory  items) 


Score  of  Category  No. 

Set  No.  1 

Case  1 

Case  2 

Case  3 

1 

86 

84 

85 

87 

2 

83 

76 

84 

7  1 

3 

100 

100 

100 

100 

4 

60 

69 

60 

68 

5 

81 

79 

80 

81 

6 

93 

93 

93 

96 

7 

82 

71 

79 

76 

8 

69 

80 

65 

76 

9 

69 

66 

69 

67 

10 

69 

68 

69 

68 

Evaluation  score 

80 

79 

78 

81 

No.  of  No's 

92 

55 

75 

76 

No.  of  applicable 

610 

334 

429 

529 

requirements 

Score  of  Category  iJo. 

Set  No.  2 

Case  4 

Case  5 

Case  6 

1 

91 

85 

89 

89 

2 

95 

93 

94 

91 

3 

90 

85 

88 

88 

4 

74 

76 

74 

76 

5 

94 

94 

94 

94 

6 

91 

99 

89 

88 

7 

77 

97 

76 

78 

8 

98 

99 

98 

99 

9 

76 

67 

71 

71 

10 

81 

80 

80 

80 

Evaluation  score 

89 

90 

87 

87 

No. 

of  No's 

47 

26 

39 

37 

No. 

of  applicable 

677 

368 

510 

512 

requirements 
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Score  oi  Category  No. 

Set  No. 

3 

Case  7 

Case  8 

Case  9 

1 

98 

97 

97 

97 

2 

64 

7  5 

66 

64 

3 

89 

88 

89 

89 

4 

46 

49 

47 

47 

5 

82 

82 

82 

81 

6 

80 

79 

79 

8  5 

7 

83 

70 

78 

82 

8 

90 

96 

86 

93 

9 

89 

88 

89 

88 

10 

85 

84 

85 

84 

Evaluation  score 

80 

79 

79 

81 

No.  of  No's 

56 

40 

53 

48 

No.  of  applicable 

378 

256 

313 

347 

requirements 

Score  of  Category  No. 

Set  No. 

4 

Case  10 

Case  1 1 

Case  1 . 

1 

89 

88 

87 

91 

2 

81 

65 

77 

82 

3 

76 

72 

76 

76 

4 

87 

86 

87 

87 

5 

97 

97 

97 

97 

6 

93 

100 

95 

100 

7 

87 

85 

84 

93 

8 

93 

91 

93 

94 

9 

99 

100 

100 

100 

10 

100 

100 

100 

100 

Evaluation  score 

91 

90 

90 

93 

No.  of  No's 

30 

22 

27 

2  3 

No.  of  applicable 

488 

334 

398 

44  3 

requirements 

Score  of  Category  No. 

Set  No. 

5 

Case  13 

Case  14 

Case  1  ‘ 

1 

70 

86 

79 

74 

2 

83 

82 

84 

82 

3 

93 

93 

95 

91 

4 

86 

89 

86 

90 

5 

96 

95 

96 

95 

6 

95 

88 

94 

92 

7 

88 

85 

85 

88 

8 

74 

78 

73 

78 

9 

79 

79 

76 

73 

10 

90 

91 

91 

90 

Evaluation  score 

87 

87 

87 

87 

No.  of  No's 

72 

41 

55 

58 

No.  of  applicable 

542 

344 

459 

436 

requirements 
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Score  of  Category  No. 

Set  No. 

6 

Case  16 

Case  17 

Case  18 

1 

90 

100 

89 

100 

2 

100 

100 

100 

100 

3 

68 

67 

71 

69 

4 

93 

91 

92 

92 

5 

92 

94 

92 

94 

6 

92 

57 

88 

94 

7 

94 

83 

93 

92 

8 

90 

86 

89 

90 

9 

100 

100 

100 

100 

10 

100 

100 

100 

100 

Evaluation  score 

92 

91 

91 

92 

No.  of  No's 

29 

19 

27 

23 

No.  of  applicable 

434 

288 

365 

384 

requirements 

Score  of  Category  No. 

Set  No. 

7 

Case  19 

Case  20 

Case  21 

1 

94 

92 

95 

92 

2 

84 

74 

82 

80 

3 

94 

94 

93 

93 

4 

71 

71 

71 

70 

5 

99 

99 

99 

99 

b 

96 

92 

96 

94 

7 

94 

92 

95 

93 

8 

89 

88 

89 

89 

9 

94 

92 

93 

95 

10 

75 

75 

75 

75 

Evaluation  score 

90 

88 

90 

89 

No.  of  No's 

34 

30 

31 

32 

No.  of  applicable 

484 

342 

433 

442 

requirements 

Score  of  Category  No. 

Set  No. 

8 

Case  22 

Case  23 

Case  24 

1 

41 

31 

40 

31 

2 

34 

41 

44 

29 

3 

86 

84 

85 

86 

4 

36 

36 

36 

36 

5 

78 

82 

80 

79 

b 

52 

55 

56 

49 

7 

54 

51 

61 

4  1 

8 

76 

7  3 

74 

74 

9 

26 

24 

24 

24 

10 

69 

69 

69 

69 

Evaluation  score 

61 

61 

62 

58 

No .  o  f  No  '  s 

189 

125 

134 

168 

No .  ot  app 1 icable 

486 

328 

372 

411 

requirements 


IL 
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Score  of  Category  No. 

Set  No. 

9 

Case  25 

Case  26 

Case  27 

1 

8b 

93 

86 

88 

2 

77 

89 

89 

78 

3 

97 

97 

97 

97 

4 

96 

96 

96 

96 

5 

100 

100 

100 

100 

6 

84 

95 

87 

85 

7 

90 

91 

89 

93 

8 

87 

93 

90 

89 

9 

91 

91 

88 

92 

10 

100 

100 

100 

100 

Evaluation  score 

91 

95 

93 

92 

No.  of  No's 

54 

29 

42 

39 

No.  of  applicable 

566 

336 

424 

4  50 

requirements 

Score  of  Category  No. 

Set  No. 

10 

Case  28 

Case  29 

Case  30 

1 

85 

90 

85 

88 

2 

76 

72 

77 

69 

3 

88 

86 

88 

86 

4 

76 

78 

75 

78 

5 

90 

90 

90 

90 

6 

79 

86 

87 

78 

7 

73 

86 

78 

78 

8 

89 

100 

95 

92 

9 

74 

53 

64 

60 

10 

100 

100 

100 

100 

Evaluation  score 

83 

87 

86 

84 

No.  of  No's 

79 

38 

55 

59 

No.  of  applicable 

592 

327 

452 

432 

requirements 

Score  of  Category  No. 

Set  No. 

11 

Case  31 

Case  32 

Case  33 

1 

100 

100 

100 

100 

2 

100 

100 

100 

100 

3 

42 

41 

40 

43 

4 

54 

51 

54 

51 

5 

100 

100 

100 

100 

6 

99 

99 

99 

100 

7 

75 

100 

74 

100 

8 

99 

100 

98 

100 

9 

100 

100 

100 

100 

10 

100 

100 

100 

100 

Evaluation  score 

87 

87 

85 

88 

No .  of  No's 

8 

5 

8 

5 

No.  of  applicable 

46 

163 

173 

206 

requirement  s 
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Score  ot  Ca * ego  ry  No. 

Set  No.  12 

Case  34 

Case  35 

Case  36 

i 

100 

100 

100 

100 

2 

88 

95 

94 

89 

3 

82 

80 

81 

82 

4 

69 

61 

70 

63 

3 

97 

96 

96 

97 

6 

90 

95 

95 

90 

7 

87 

91 

92 

84 

8 

89 

90 

91 

87 

9 

97 

97 

97 

97 

10 

73 

71 

71 

75 

Evaluation  score 

87 

87 

88 

86 

No.  oi  No's 

47 

34 

34 

47 

No.  of  applicable 

439 

302 

344 

395 

requirements 

Score  of  Category  No. 

Set  No.  13 

Case  37 

Case  38 

Case  39 

1 

97 

95 

97 

97 

2 

90 

93 

92 

88 

3 

71 

62 

66 

66 

4 

68 

55 

69 

57 

5 

100 

100 

100 

100 

6 

100 

100 

100 

100 

7 

93 

97 

98 

98 

8 

96 

100 

98 

93 

9 

100 

100 

100 

100 

L0 

72 

72 

72 

72 

Evaluation  score 

88 

83 

86 

85 

No.  of  No's 

24 

18 

19 

21 

No.  of  applicable 

287 

170 

201 

218 

requirements 
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